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ABSTRACT 

A theory of Socratic tutoring ira.s developed in the 
f or» of pattern^action rules for a computer program. The rules were 
derived froi analyses 'bf a variety of tutorial 'dialogs. The 23 rules 
were designed to formalize causal knowledge and reasoning, and they 
included such abilities as forming hypotheses, distinguishing between 
necessary and sufficient conditions,^jiakin^ uncer^^n predictions, 
determining the reliability and limitations of *ffese predictions, and 
askifag the right question when there is not enough information t6 
make a prediction. (EMH) 
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INTRODUCTION 

I 

The purpose of education must always .be twofold: to 
teach a variety of knowledge and to teach the sJtills 
necessary for applying that knowledge to new problems or 
situations. These twin goals are perhaps ach/eved' most 
successfully thrp4gh what is usually called t^ie Socratic 
metfiod ^of teaching; The Socratic method orjtginated in the 

✓ 

Meno dialogue of Plato (.1924), but the metli0d has reappeared 
in different guises throughout history/ (e.g. , the inquiry 

method, the case method) as it has beetv applied to different 

I* / ' 

kinds of knowledge. The* central / notion is to force the 

.-/ 

student to reason for himself, to derive general . principles 
from specific cases, and to apply the gener?il principles 
that have been learned to new cases. 

( In the Socratic method the student learns three kinds 
otj things: (1) specific information about a variety of 
cases; (2) the causal dependencies or priaqiples that 
underlie these cases; and (3) a variety of reasoning skills. 
These include such abilities as formi'qg hypotheses, testing 
hypotheses, distinguishing between necessary and sufficient 
conditions, making uncertain predictions, determining the 
reliability or limitation of these predictions, and asking 
the right questions when^ there is not enough information to 
make a prediction. 



The objective of this pape* is to define in ^-iw^ecise 
terras wh^t the Socratic method is and how in fact It 
accomplishes these, goals. To this end, I have examined a 
variety, of dialogues involving the Socratlc method and tried 
to formalize the tutoring strategy used, in these dialogues 
-as pattern-action rules or production rules (Newell & Simon, 
1972), which take the form' "If in situation X, do Y" . The 
purpose of writing the rules as productions, is to express 
the theory in a procedural formalism, that Is independent of 
the particular content. ^ I will also try to specify the 
reasoning skills that each particular production rule is 
designed to elicit. 

' But what is the use of such a tlfeory? The specific use 

I see is in developing aA intelligent CAI system (Brown & 
Burton, 1975; Collins et ' al-, 1975; Goldstein, Papert & 
Minsky, in press), ^ that can apply as many of these 
atrategles as possible in tutoring causal knowledge and 
reasoning. Heretofore the Socratic method has not been 
considered viable for education generaly, because it is a 
orie-on-one teaching strategy (though R.C. Anderson points 
o\y/ it can be used very successfully in a class). However, 
the developing technology for building intelligent CAI 
systems may make it possible to teach many more students 
with such a tutoring strategy. 

* 

More generally the reason for trying to specify the 



t 

Socratic method Is to move it from the domain of folk wisdom 
to science. By attempting to fo^mu^ate the Socratic method 
as a set* of strategies, other theorists have something 
specific to challenge or revise- Once science has something 
ta chew on, it will inevitably grind the thing Into-shape, 

A THEORY OF SOCBATlC TUTORING 

' ■ < 

While In one sense the Socr§itlc method is a single 
approach that Involves teaching th^student to reason from 
cases, in another sense it' is made up' of a variety of 
spetJific strategies that good teachers hit upon in t-he 
course of their teaching. • Some hit upon one net, some upon 
another, though* there is usually some overlap. There is 
little need for teachbrs to verbalize these -strategies, 
since their application only depends or/ an intuitive feel as 
to how to use* them. If they are taught, they are usually 
taught by example. So there Is no very specific body of 
knowledge about the Socratic method, and hence there Is no 
theory to be extended and refined..^. In fact until computers 
provided us with fornallsns for expressing "process models," 
it ts- unlikely th^it anyone would have thought of 
constructing a speci fic^ theory about such a thing as the 
Socratic method, v *^ 

^ In order to develop a computational theory of the 
Socratic method, I have been looking at a" variety of 



dialogues., These included sbme dialogues that I conducjled 
myself to teach causal dependencies about geography (Collins 
et ai., 1975), several hypothetical dialogues developed by 
B.C. Anderson (1972) to illustrate aspects of the Socratic 
methodi and several dialogues pro/Iuced by the Socratic 
system developed- by Feurzeig (fjeurzeig, Munter, Swets, & 
Breen, 1964; Swets & Feurzeig, 1965^0. The objective is to 
extract from these dialogues most of the specific strategies 
that occur and phrase th^ra as production ruled. There is no 
guarantee of^ exhaustiveness in /this approach but it should 
be possible to capture the major strategies. 

The product ion ' rules are ' formulated in terms of the 
functional dependencies in knowledge and .*;eneralr situations 
that occur in a dialogue. Different rules can often be used 
in the same, situation and .sometimes application of one can 
be delayed until after application of another. Similarly^ 
sometimes one rule is natural follow up to another rule. So 
what isn't apparent in the enumeration of the rules is the 
structure of interactions between different rules. This, 
requires a second order theory of teaching strategy that 
incorporates a notion of what rules are most appropriate to 

invoke, in different situations. 

* 

In order to explain the terminology used in the rules 
that will be presented, it is helpful to » consider an 
example. Figure 1 shows the causal dependencies derived by 




Fig. 1 A student's analysis of the causal factors 
affecting rice gr*owing. 
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a student in one of the dialogues that I conducted on rice 
growing (Collins/ et al . , 1975). Rice grfiwipg is th^ 
dependent variable , and in this case it is treated as having 
two possible v^j.ue5 ; either you can grow rice or you can't. 
Unlike rice growing, which the student treated as a' 
threshold function, many ^dependent variables are treated as 
continuous functions (e.g. a place is colder or warmer), 
where there is a continuous range of values. 

During the course of the dialogue the student 
identified --fo^ principal^ factors affecting rice growing: 
fresh water, a flat area, fertile soil, and warm 
temperature. These were configured as shown in the diagram. 
The factors (or functional djEae rminant s ) such as heavy 
rainfall or flab terrain are linked, to rice growing through^^ 
drains with various interned late steps . n fact any nodi* in 
a chain can be considered as a factor. The diagram itself 
represents only a top-level description, and any node or 
link in the diagram can be exp^ded indefinitely • Causal 
links expand into intermediate steps, so that for example 
"irrigation" can be considered an intermediate node on the 
chain from "river or' lake" to "supply of fresh water". 

Given the dependencies in the diagram, it is apparent 
that a factor like hea^vy rainfall is neither necessary nor 
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sufficient for rice growing. It is not necessary because 

\ , . ,. . ■■■■ 

obtaining a- supply of fresh water (which is a necessary 
factor) can also be satisfied by irrigation from a river or 
li^ke. It is not sufficient because other factors, such as a 
warm temperature are required. When prior nodes are 
connected into a node by an "or", any of the prior nodes is 
sufficient and none is necessary with respect to that node. 
For example, either heavy rainfall or a river or a lake is a 
sufficient soiarce for fresh water, but nohe of these is 
necessary for fresh water. tn contrast , '^when prior nodes 
are connected into a node by an "and", all of the prior 
nodes are necessary and none is sufficient wi.th respect to 
that node. For example, fresh water is necessary to flood a 
flat area, but is not sufficient. Though heavy rainfall Is 
sufficient as a source of fresh water, It Is not safficient 
for growing rice, because of the "ands" in the causal 
structure between rainfall and rice* By moving down any of 
the chains, one gets to aVigher level of abstraction. But 
it is not, always helpful to know only the most general 
causes (i.e. the nodes immediately prior to the dependent 
variable), because the Information available ^ about a 
particular ■ case is often restricted to specific factors 
fifrther "back in the causal structure. 

There are different -kinds of dependent variables: some 
vary continuously as do temperatucie or rainfall, and some 
vary discretely. For* example, different diseases can be 

11 
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regard«id as different values on single dimension of what's 
'Wrong vith a patient. Wheat,, rice,, and .corn can be regarded 
as different values on a dimension of what grain can be 
grown in a glyen region. There are several differences 
between the dl*«crete and continuous cases. First, in the 
discrete case there may be more or less than one. of the 
values for the dependent variable present (e.g-s 3 patient 
may have more than one disease or no disease at all), 
whereas in the continuous case there can only be one value. 
Second, in the discrete case different causal factors may be 
relevan t for the prediction of different values on the 
dependent variable (what factors are relevant for predicting 
mumps may be different from cancer), whereas In the 
continuous case the same factors are always relevant or 
^ Irrelevant for making a prediction. 

There is a third difference that cuts across the 
discre'te-cont inuous distinction. In cases such as medical 
diagnosis or electronic troubleshooting, the causality runs 
rrom the dependent variable to the functional determinants 
(e.g. the disease causes the symptoms), ythereas •in case:^ 
like grain-growing or "lemperature the causality runs from 
the functional determinants to the dependent variable. In 
the case of Identifying a letter from Its features there Is 
no causality In either direction, but still different 
.letters' can be treated as values of the dependent variable 
and th^e features as different factors. ^ Despite these 

I . 8 
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dlffereace's Irj the- domains of knowledge studied, It turns 
^^J^dit^ the. tutoring strategies can be characterized In a single 
franieWprk. • ^ 

: ' I have listed below the rules -(or Impdrtant^ strategies) 
derived so fa^;, as well as brief explanations of why they* 
are effective strategies . Examples of each are given, in 
terras oT the causa!^ factors for average temperature or for 
growing rice. More examples will occur in the following 
section- where the rules are illustrated by some of the 
actual dialogues from which they were derived. 

RULE 1: Ask about a known case , 

If 1) it is the start of a dialggue , or . ^' . 

2> there is no other strategy to invoke, 

then 3) pick a well-known case .and ask what 

<> 

the Value of the dependent * variable is for that 

« >> • • ' • 

tDase, or • 

^ ask the student if he knows a case with a 

particular value on the dependent variable. 

EXAMPLE: 

Ask the student "Do they grow rice in China?" "or 
"Do you -know any' place where rice is grown?" 
REASON FOR USE: 

It brings out any well-known .cases the student knows 
about such as rice growing in China. 

r 13 ■ 
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RULE 2: Ask for any factors • - . 

If 1) a student asserts that a cage has a particular 
value on -the dependent variable, 
then 2) ask the student why. 
EXAMPLE : ^ ■ 

If a student says they grow rice in China, ask why. 
REASON FOR USE: 

Thi6 determines what causal factors or chains the 
student knows about* 
RULE 3 : A^ for intermediate factors 

If 1)* the student gives as an explanation a factor that 
is not an immediate cause in the causal chain, 
then 2) ask for the intermediate steps. 
EXAMPLES 

If the student mentions monsoons in, China, as a reason 
for rice growing, ask "Why do monsoons make it possible 
to grow rice in China?" 
REASON FOR USE: 

This insures that the student understands the steps 
in the causal chain, for example that rice needs » 
to be flooded. 

RULE 4: Ask for prior factors 

If 1) the student gives as an explanation a 

factor on causal* chain where there are 

also prior factors, * 
^ . " 

then 2) ask the* student for the prior factors. 

■ . 14 
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EXAMPLE: ' 

If the student 'mentions water as a factor in . 
growing rice, ask him "What do you need to get 
enough water?" , 
REASON FOR USE: 

Sane as RULE 3. . - 

RULE 5: Form g. general rule for an insufficient factor 
If 1) the student gives as an explanation one or 
more factors that are not sufficient, 
thfen 2) formulate a general rule asserting that 
the factor given is sufficient andask 
the student if the rule is true. 

EXAMPLE: 

\ 

f ■ • 

If the student gives water as the reason they 

i grow rice in China, ask him "Do you think any place 

With enough water can grow rice?" 
REASON FOR USE: 

This forces the student to pay attention to other^^ 

causal factors. 
* .. ^ * . 

RULE 6: Plok a counterexample for an Insufficient factor 

If 1) the student |5lves as an explanation one or 

more factors that are not sufficient, or 

2) agrees to the general rule in RULE 5, 

then 3) pick a counterexample that has 

the right value on the factor (s) given , but 

-c 
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the wrong value on the depetVdent variable, and 

4) ask what the valjife of the dependent variable is 
for that case, or 

5) ask why the causal dependence does not hold for 
- that case. 

EXAMPLE: 

If a student gives water as the reason they grow* 
rice in China or agrees that any place with enough . 
water can' grow rice, pick a place like Ireland 
where there is enough water and ask "Do they grow 
rice in Ireland?" or "Why don 't^they grow rice in 
Ireland?" 
REASON FOR USE: 
Same as RULE 5. 

♦ ... 

RULE 7: fficm A g^'ng.ral rJilS. Ian aa unnecessary factor 
If 1) the student gives as an explanation one or more 
factors that a're not necessary, 
then 2) formulate a general rule by'asserting that the 

the factor is necessary and ask the student if 

^ . 'y 

the rule is true. 

EXAMPLE: 

If a student says r£i,infall is a reason for growing rice, 
ask "Do you think it is necessary to have heavy rainfall 
in order to grow r^ice?" ^ 
REASON FOR USE: • \^ 

This forces the student to consider the necessity of a 

IG 
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particular factor. *• 

RULE 8: Pick a counterexample fsL 3J1 unnecessary factor 
If 1) the student gives as an exp^^ation one or more • 
factors that are not necessary., or 
2) the student aftpees to the general rule in 

RULE 7, • • . •' 

then 3*) pick a counterexample with the wrong value on 

the factor and the correct! value on the dependent 

variable, and 
U) ask the student what the dependent value is for 

that case , or • 
5) ask why the causal dependence doesn't tiold in that 

case. . 

EXAMPLE: 

If the student gives i>a-infall as a reason for growing 
rice, ask "Do you think they can grow rice in Egypt?" or 
"Why do they grow rice in Egypt when they don't 
have much rainfall?" ^ 
REASON FOR USE: ' - * 

Sane as Rule 7. - r ; 

RULE 9: Pick a case wijLll aa aJtiOlfilflfi HJCSm. ISlHS. 

It 1) the student is missing a particular factor, 
then 2) pick a casi^with an extreme wrong value on that 
factor and ask why not there. 

EXAMPLE: 
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If the student^ has not ment ioned temperature with respect 
to rice growings ask "Why don't they grov rice in 
Alaska?" 

REASON FOR USE: - , ^ • 

ThK's forces the student to pay attention to any factor he 
is ignoring. ' , 

RULE 10: Pqs^ a misleading Question 

If 1) there is a case where a secondary factor 
overrides the primary factors, 
then 2) pose a misleading question to the student, based 
on the fact that the -value of the dependent 
variable is^different from what would be 
predicted from the primary factors above, 
• or • 

3) pose a misleading choice as to the dependent ^ 
'* variable betv/een two cases where consideration 
of the primary factors alone leads to the wrong 
prediction . - . 

EXAMPLE: 

Because the tree cover in the Amazon jungle keeps 

the temperature down to a high of about 85 degrees^ 

•* . 
ask the student "Do you think the temperatures in -the 

Amazon ju|i^le reach a 100 degrees?!' or "Do you 

think, it gets hotter in the Amazon jungle or Texas?" 

REASON FOR USE: 

• - 
This forces the student to learn about common exceptions, 

13 

. 14 ■ 

\ 



about secondary factors, and about the limitations 
of general rules. * 

RULE 11: Specify hsw tjifi variable depends oq a Riy^n 
facto r 

If 1) the student mentions a factor, but does not 

specify' hoV the dependent variable varies with that 
factor, or 

2) . only partially specifies the re^lationship , 
then 3) ask him to specify the relationship more precisely, 
* or 

^) suggest a possible relationship to him. 
EXAMPLE: 

Ask the student "Can you say how temperature depends on 
latitude?" or "Does average temperature increase 
linearly the further south you go.?" 
REASON FOR USE: 

This forces the student to specify more precisely the ^ 
functional relation between the factor in question and 
the dependent variable. 

RULE 12: Probe for a necessary facto r 

If 1) a student makes a wrong prediction on the 

dependent variable because he has not identified 
one or more necessary factors, 
then 2) tell him he is wrong, and ask him' to think ofy 
ano/her factor t^iat is necessary. 

13 ' 
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EXAMPLE: 

If a student thinks they can grow rice in Ireland because 
it's wet, point out they can't grow rice there and ask 
"CCn you make a hypothesis about what other factor- 
is n4icessary for rice growing?" 
REASON FOR USE: 

This forces the student to use hypothesis formation as a 
systematic strategy for dealing with ufrexplained 
problems. 

RULE 13: Pro&t tSlL A sufficient factor 

If 1) a student makes a wrong prediction on the dependent 
variable because he treats a factor as necessary 
when It is not , ^ 
then 2) tell him he is wrong* and ask him to formulate a 
hypothesis about another factor that might be 
sufficient. ^ ^ 

EXAMPLE: 

If a student thinks they cannot grow rice in Egypt 
because there is little rain, point out they can grow 
rtce therifl! arid ask •'Can you think of what other factor , 
makes it possible to grow rice there?" 
REASON FOR USE: . ^ 

Same as RULE 12. 

RULE 14: Probe for differences between two cases 

If 1) a student eannot think of a factor that could 
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account, for different values of the dependent 
variable betwe'en two cases, 
then 2) ask him to consider what the differences are 

V 

between the two cases that "iight account for the 

difference In the dependent variable. 

EXAMPLE: ' 

If a student cannot think' of why they can grow rice In 

China but not In Alaska, ask what the differences are 

between China and Alaska that miRht account for the 

difference In rice growing. 

REASON FOR USE: ' ' . - • 

\ - 

^ame^as RULE 12. 

, ' ' - ■ . \ 

RULE 15: Reques t a test oX the hypo thesis about a factor 
If T) the student has formulated a hypothesis, about how 
the dependent variable is related to a particular 
factor, 

then 2) ask him how it could be tested. 
EXAMPLE: 

Ask the student " If you want 'to test whether distance 
from the ocean affects temperature, would you compare 
the temperature in January for St. Louis to Washington, 
D-C. or Atlanta?" 
REASON FOR USE: <^ 

By getting the^student to test hypotheses , it forces him 
to learn how to control other* factors that might affect 
the variable . 

21 
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rulI^ 16: aaK £fic t predicUon about m wKnown qas& 

If 1) a student has identified all 'the primary fac,tors 
that affect the dependent variable, 
then 2) pick a case that is either hypothetical or unlikely 
^ to be known and ask the student to predict tire 

* likely value on the variable for tha^ case. 

EXAMPLE: 

'if the student has identified the factors that atfect 

rj^yp growing, then ask "Do you think they can grow 

rice In Florida?" 

REASON FOR USEi 

This forces the student to use the factors he has '^.^^ 

♦ 

accumulated in a predictive way. i 

RULE 17: Aftk what qre the relevant factor a tfi conalde r * 
If 1) the student can't make a prediction, 
then 2) ask the student what are the relevant ".factors 
to consider. 

EXAMPLE: 

•Aak the student "If you can't predict whether they grow 
ric« in Florida, what factors do you need to consider?" 
REASON FOR USE: 

This^ teaches the student to ask the right questions in 
trying to make reasonable predictions about new cases. 

RULE 18: Question prediction sia1& without fiOfiMKll 
information 
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If 1) a student makes a prediction as to the value of the. 
dependent variable on the basis of some set of 
factors, and 

2) there is another value consistent with that set of 

" • > ^ 

factors , - . 

then 3) ask the student why not the other value. 

EXAMPLE: 

* If the student predicts they grow wheat in Nigeria 
because it is fertile and warmt ask hira why not 
rice. 
REASON FOR USE: 

This forces the student not to Jump to conqlusions 
without enough information. 

RULE 19; ?<?inK QUk Irr^t^ygnt f^q^Qn 

If 1) the student asks about the value of an irrelevant 

4 

factor in trying to make a prediction, 
then 2) point 'Out the factor is irrelevant, or 

3) ask whether, the Irrelevant factor affects the 

li * 

dependent variable. 

EXAMPLE: " 

If the student asks whether . Denver or Salt Lake City is 
furthe# west in trying to decide whit^h has the 
colder temperature, then point out that longitude doesn 't 
matter, or ask whether longitude affects temperature, 

REASON FOR USE: 

This forces the student to learn what Is irrelevant, as 

23 ' 
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^ well «a what is relevant, in making any deciis'lon. 

RULE 20: Poin^ Inconalatent prediction 

If 1) a student makes a prediction about '•the dependent 

* ' 

variable inconsistent with any of the values of the 
factors discussed, * 
then 2) point o^ut the inconsistency, or . 

3) ask whether the value of the factor discussed is 
consistent with his prediction about the dependent 
variiible. / 
EXAMPLE: ^ 

IT the student predicts they grow rice in Spain after the 
dryness of the climate has been discussed, either 
point out that a dry climate is incompatible with rice 
unless there is irrigation, or ask how he thinks they can 
grow rice when the climate is so dry. 
-REASON FOR USE: 

This reminds the student to consider al^ the relevant 
factors in making a prediction, and Insures he 
understands the relation between the factor and the 
dependent variable. 



yLE 21: AaK IfiC CQnaidftratign 2L a possible value 
\If 1). there is a value on the dependent variable 
N that has not -been considered and which either is 
consistent With .several factors or important to 
cohsider a priori, 
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then 2) ask the student to consider that value. 

EXAMPLE: . ' 

If the Student hasn't considered rice as a 
possible grain in Nigeria, ask hire to -bonsider it. 

REASON FOR USE: 

this forces the student to actively consider alternatives 

in making any prediction. 

RULE 22: T^at for consistencv with a KiXfia hYPOthe?!? 
If 1) a particular value on the dependent variable is 
being *consideredt and 

2) the values of one of more relevant factors have 
been discussed, but 

3) . whether these values are consistent with the 

particular value of the dependent variable has 
not been discussed, 
then picJc one or more of the factors that are 

consistent with the dependent variable and ask 
if they are consistent, or 
5) pick one or more of the factors that are 
inconsistent with the dependent variable 
. and ask if they are consistent. 
EXAMPLE: . ^ > * 

If the hot climate and rainfall in Java has been 
discussed, the student can be asked "Is the heavy 
rainfall in Java consistent witk^^growing wheat?" 
or "IS the hot climate and heavy rainfall 
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consistent with growing rice?" 
REASON FOR USE: 

This tests whether the student understands the functional 
relations between the various factors and the dependent 
variable . . 

RULE 23: Ask for consideration al relevant factors 

If 1) a student makes a wrong prediction in a particular 
case , or 
2) cannot make a prediction, 
then 3) pick the most relevant factor not discuVs^d 
and 

4) ask student what the vali^ of that 
^ factor is for th* particular case. 

EXAMPLE: 

Ifvthe student predicts that thf average temperature 
is very hot in Buenos Aires, ask if he knows what the 
latitude of Buenos Aires is. 
REASON FOR USE: 

This forces the student to consider relevant factors 
in making a prediction, and elicits wTiether 
a mistake is due to wrong information about a 



case, or a mistake about how the dependent 



variable varies with different factors. 
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DATA ON WHICH THE THEORY IS BASED 

In this section I have included segments of some of the 
dialogues I hkve been looking at In order to, specify the 
various tutoring strategies used in the Socratic method. 
Each rule ^from the previous section that is used in one of 
the dialogues is indicated in parentheses* Often the tutor 
is not applying one of the tutoring strategies but answering 
a student's question or further specifying a question » 
Sometimes, however, he may be applying a strategy that has 
not yet been incorporated into the theory, through ignorance 
or oversight'. 

Tables 1 and 2 show fragments ofytwo of the dialogues I 
conducted to teach different causal interdependencies in 
geography (Collins et . al . , 1975) . These dialogues show 
heavy use of the counterexample strategies (Rules 6 & 8) and 
the strategies directed towards getting the student to make 
predictions using , the factors he accumulated. The student 
appeared to be learning a great deal in these dialogues as 
is derailed in Collins, et al . 

Table 1 ^ includes fragments from a dialogue about 
grain-growing (in particular, rice, wheat, and corn) 
conducted^ with *a rather sophisticated student. Th~e 



Table 1 • 

Fragments of a dialogue on growing grain (Collins et al,, 1975) 

1 T:- Where in North America do you think rice might be 

■ i> 

grown? (Rule 1: /Ask about a known case) 

2 S: Louisiana. 

3 T: Why thehe? (Rule 2: Ask for any factors) 

4 S: Places where there is a lot of water. I think rice 

requires the ability to selectively flood -fields . 

5 T: O.K. Do you think there's a lot of rice in, , say, 

Washington and Oregon? (Rule 6: Pick a counterexample 
for an insufficient factor) 

6 S:- Aha, I don't think so. 

7 T: Why? (Rule 2: Ask for any factors) ^ 

8 S:. There's a lot of water up there too, but there's, two 

reasons. First the climate isn't conducive, and 
second, J don't think the land is flat enough. You've 
got to have flat land so you can flood a lot of it , 
unless you terrace it. 



9 T: What about Japan? (Rule 8: Pick a counterexample * for 
an unnecessary factor) 

10 S: Yeah, well they have this elaborate technology. I 

suppose for terracing land so they can flood it 
selectively even though its tilted overall. 

(section omitted) 

11 T: Hfi you think they might grow rice in Florida? (Rule 

16: Ask^for a prediction about an unknown case) 

12 S: Yeah, I guess they could, if there were an adequate 

fresh water supply. Certainly a nice, big, flat area. 

(section omitted) 

13 T: What kind of grains do you think they grow in Africa, 

and where; then? (Pause) Well, where would they grow 
rjice if they grew it anywhere? (Rule 16 again) 

14 S: If they grew it anywhere, I suppose they'd grow it in 

the Nile r.egion, and they'd grow it in 'the tropics 
where there was an adequate terrain for it. 

V 

(section omitted) 
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15 I: What do you think they, live on" (in West Africa)? (Rule 

16 •gain)' ^ ' . ■ ' ■ 

• ■ - ' ', ' , 

16 S: I gu«Ba they grow aome kind of grain in Weat Africa. , 

17 T: What kind is moat likely? 

18 S: Wheat. 

19 T: You think wheat ia the moat likely grain? . 

20 S: Wheat or aome combination of wheat and rice if they 

can grow it, and I auppoae they could. I don't really 
know much about^the gedgraphy there, but I auppoae 
there are placea, like Nigeria is pretty damn fertile. 

21 t: O.K. ita fertile but what other qualitiea? Is the 

temperature warm or cold? (Rule 23: Ask for 
conaideration of different factora) ^ 

22 S: Yeah,' the climate'a temperate and... 

23 T: Do they have rain or not? (Rule 23 again) 

24 S: Yeah. 
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25 T: They have a lot of rain. O.K. What do those kind of 

configurations predict'' as far as grain? (R-ule 16 
again) ^ * * 

■r 

a 

26 S: Rice. 
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btginping aection of Table 1 (lines 1-10) illustrates the 

■ • 

use of both counterexample strategies. In one case (line 5) 
th« tutor chose Washington and Oregon because they have a 
lot of water but no rice; in the other case (line 9) he 
chose Japan because it is mountainous, but has rice. In the 
first case enough water was not sufficient for growing rice; 
In the second case flat land w^s^ot necessary for growing 
rice, 

• 

The next three segment? of Table ^ 1 show the tutor 
asking for predictions about unknown cases (lines 11, 13 and 
15) afttr the student had developed the, structure . of 
causality about rice«*growing depicted In Pig. 1. In the 
last case the student incorrectly predicted that wheat is 
grown in Nigeria, so the tutor asked him to consider the 
relevant factors one by one. After doing this the student 
changed his prediction to rice, which was correct. 

Table 2 sho#s the middle of a dialogue on . y^opulation 
density with a less sophisticated student than the one 
above^s^o get this student to think- about the relevant 
factors, it was often necessary to use a strategy of picking 
a case^ which nas an extreme wrong value on one of the 
factors that affects the dependent variable (i.e. 
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Table 2 

Fragments from the middle of a'dialogue on 
population density (Collins et al, 1975). 

1 T: In Northern Africa is there a large population density 

there? (Rule 9: Pick a case with an extreme wrong 
value) , 

2 S; In Northern Africa?'I think there is. 

3 T: Well ther© is in the Nile valley, but elsewhere there 

is not. Do you have any idea why not? (Rule 1?; Probe 
for a necessary factor) 

4 S: Because its not good for cultivating purposes? 

5 T; Its not good for agriculture? 

6 S: Yeah. 

7 T: And do you know why? (Rule 4: Ask for prior factors) 

8 S: Why? 

9 T: Why is the farming at a disadvantage? 

33 
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10 S: Because its dry. 



11 T: Right. 

(auction onitted) 

12 T: Do you know why ther^ is sparse, population In Tibet 

now? (Rule 9 again) \ 

13 S: Because its deserty^ 
1* T: Mo. 

15 S: No? I don't know. Oh you said It was mountainous. 

16 T: Very mou^alnous. 

17 S: So It isn't good farmland, 

18 T: OK. It's very tough to farm when you have mountains 

there. You only have valleys to farm in. O.K. - Now 
do you think its very dense in Alaska? (Rule 9 again) 

19 S: No. 

* 

20 T: Why? (Rule 2: Ask for any factors) 

31 
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21 S: i would imagine because of the cold. 

22 T: The cold climate. And why does a cojd climate...? 

(Rule 3: Ask for intermediate factors) 

23 S: There again you would have the problem of farming and 

|igriculture . 

2H T: O.K. And are there possibly other' reasons why a cold ^ 
C climate leads to low density? (Rule 3 again) 

A 

•25 S: Yeah. You would use up more heat and fuiel . They 
wouldn't think of it as a desirable place to locate. 



4 
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population density). Thus, northern Africa (line 1) waa 
rfhoaen to elicit dlacuaalon abqut water, Tibet (line 12) to 
elicit cdiacuaalon about mountains, and Alaaka (line 18) to 
eliolt dlacuaalon about cold climate. The extreme value in 
each caae forced the student to pay^attentlon to a relevant 
factor ahe waa Ignoring. 



In the dl^^Uaalon about Alaaka, the tutor 'a probing for 
varlou»^4ii^^meW^te and prior factors led the student, to 
^oonatruct a aomewhat complex network of cauaal 
Intarconnectlona. In particular, the student sugf^<%j:ed that' 
cold climate leada to low population density by three cauaal 
chains: one through agrlcultoral problema, one through fuel 
needa, mnd one through people 'a dealre not to aettle In cold 
climattfir. Earlier two other factors, dryness and mountains, 
had been cauaally^ linked to agricultural problems. This 
11 lustra tea the complex interconnections that can occur 
among causal chains. 

. Table 3 is a hypothetical dialogue developed by 
Anderaon (1972) to llluatrate the power of the Socratic 
method aa a teaching strategy. What is most Important about 
the teaching strategies in this dialdgue la the way they 
force the atudent to use hypothesis formation and teatlng as 
ayatematF^ strategiea for reasoning about causal 
dependenciea . 
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Table 3 

A hypothetical dialogue by R.C. Anderson (1972) 

1 T. Which is likely to "have the coldest winter days, 

Newfoundland or Montana? (Rule 10: Pose a misleading 
choice where a secondary factor " overrides- the primary 
factor) * 

2 S. Newfoundland. 

3 T. Please give your reasons for anawering Newfoundland. 

(Rule 2: Ask for any factors) 

1 , ■ . 

M S. Newfoundland is further north. 

5 T. Yes, Newfoundland is further north than Montana| Are 

you arguing, then, that if you take any two places in 
the Northern Hemisphere, the one which is further 
north will have the, lower average winter temperature? 
(Rule 5: Formulate a general rule for an insufficient 
factor) 

6 S% Yes, r guess so- -V 

7 T. I'll tell you now that Montana has lower average 

winter temperatures* than Newfoundland. Does this fact 
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cause you to change your reasoning? (Rule 12: Ask for 
another necessary factor) 



If 

8 S. Yes. 



•'v^9 T. In what mmy7 

^ 10 S. Being further northr isn't as important as I thought. 

• > 

11 i. Please try to be more precise. Would you, for 
instance, say that if you take any two places in the 
Northern Hemisphere, the one furthest souUi has the 



colder winter temperatures? (Rule 11: 



Specify the 



relationship between a factor and the varljable) 

12 S. No, I wouldn't say that. 

13 T. What would you say? (Rule 11 again) 

14 S. ' I m not sure . 

15 T. Would you say that how far nor,th a place is has no 

effect on temperature? (Rule 11 again) 

16 S. No, I know it has some effect. 
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17 T. Y«», you're right. Distance north does affect 

temperature, so what do you conclude? (Rule 12 again) 

18 S. I don't understand the question. 

19 T. You know that how far north a place is situated, is 

one factor that affects the temj>era^ure. Yet, you 
also know that, even though it is further north, 
.Newfoundland has higher average winter temperatures 
than Montana. What Aust this mean? (Rule 12 again) 

20 S. Some other factor besides north-south distance must 

also affect temperature. 

21 T. Yes! Right! What could this factor be? 

22 S. I don't have any idea. 

23 T. Why don't you look at your map of North America. Do 

you see any differences bet^<een Montana and 
Newfoundland? (Rule Ask for differences between 
two cases) 

24 S. Montana is in the centre of the country. Newfoundland 

is vii the ocean. 
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25 T. What do you mean ^by "in the centre of the cd*untry?" 



26 S. It^'s a long way from the ocean. 



27 T. Do you suppose that distance from the ocean affects 




temperature? 



J^6 S. I ^m not sure . It- would Just be a guess. 



29 T. Truef The name for such a guess is hypothesis. 
Supposing the hypothesis were correct, what exactly 
would you predict? (Rule 11 again) 

30. S. The further. a place is from, the ocean, the lower the 
temperature will be in the winter. 

i 

31 T. How could yoi^ test your hypothesis? (Rule 15: Ask tor 

a test of hypothesis about a factor) 

32 S. By comparing temperatures of place3 different 

distances from the ocean. 

33 T. Very good. Let's do that. Suppose we take SL* Louis, 

Missouri. Which would be best to compare, Atlanta, 
Georgia, or Was^ngton, D.C ? (Rule 15 again) 
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34 S* I'm not sure. 



35 T.'Why don *t you look at your map? Mayb^ that will help 

you decide , . 

36 S. 'I would pick Washington. 



37 T.'Why? . .^^^^^ 

" ' ■ f 

38 S. Because it^s at the same latitude as St. Louis, 



39 !• Why is that important? 

40 S. Well,, if Atlanta were warmer, I wouldn^,.know whether 

it was^^ because it was' nearer thej ocean or further 
south. ' V^^- 



4T T, (3ood thinking. 
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In Table 3 the, initial question by the tutor was 
designed to entrap the student into saying that Newfoundland 
4s colder "than Montana, because its latitude is further 
north", when in fact Newfoundland is warmer, because of the 
ocean* A similar kind of entrapment occurred in one of my 
dialogues, where the question was designed to elicit a wrong 
prediction about the value of the dependent variable: 
(T) Is it very hot along the coast here? (points to Peruvian 
Coast near th^ equator) (Rule 10: Pose a misleading 
question where a secondary factor overrides the primary 
factor. > 

4 

(S) I don't remember. - 

(T) No* It turns out there's a very cold current coming up 

^ along the coast; and it bumps against Peru, and tends to 

- .1), H . 

make the coastal area cooler, although " it^s near the 
equator. 

Like the counterexample and extreme value strategies this 
strategy involves the eareful selection of cases to bring up 
certaii^i factors. ^ 

In line 5 the tutor formulated a ^;eneral rule, which 
was incorrect, by suggesting that the insufficient factor 
(latitude) mentioned by the student was sufficient to 
determine the dependent variable temperature (Rule 5)» This 
strategy is an alternative to selecting a counterexample by 
• - • ■ <> 
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Rule 6 ( •♦London is further north than New' York and yet it's 
warmer") or telling the student he is .wrong and asking for 
another factor that affects temperature (Rule 12). Though 
it djid not occur in any of the dialogues, there rauSt also be 
the possibility of" form'ulating a general rule (Rule 7) !oy 
asserting that an unnecessary factor the student mentions is 
♦necessary. 

When the student agreed to jthe general rule, the tuto/ 

pointed out the error (line y) and started a series ^of 

questions designed to force the student to figure out that 

distance from the ocean affects temperature. By applying 

Rule 12 in line 7 and again in lines 17 and 19, the tutor 

tried to get the student to hypothesize another factor that 

might account for his arror in prediction. In lines 11, 13, 

and 15 he tried to test the student's understanding of the 

■ 

relatiol^ between latitude and temperature (Rule 11). 

Finally, in line 23 he asked the student to consider what 

differences between the two -cases might account for the 

effect on the dependent variable (Rule 14), and tAis 
succeeded in eliciting distance from, the ocean. 

The tutor then tried to get the student to test the 
hypothesis he had formulated; first by asking a very general 
question (li^ 31), and then a quite specific question (line 
33). In lines 35, 37, and 39 the tutor appears to be using 
variations of several of the rules (Ru-les " 14, 2, and 4 



respectively) with a dependent variable something like "good 

# 

VS. bad comparison in order to test the effect of distance 
from the ocean," but it is not clear to mfe how to fit the 
rules above, or any other rules, to,, the three questions. 
This failure suggests that the rules as presently forraul^ated 
are too close to the surface structure of the dialogue. 

The hypothetical dialoguej^y R.C. Anderson in Table 4 
illustrates the use of the Socratic strategy for tutoring 
moj^ causation. It shows an extended use of > two similar 
cases to elicit causal factors that can account for the 
student's assertion that the cases differ on the dependent 
variable (i.e. whether the rebels should be admired or 
not). A similiflr' extended comparison of two cases occurred 
in a dialogue on population density (Collins et al., 1975) 
where the comparison was between Java with high density and 

other Indonesian islands with low density. Comparison of 

' ft 

cases is intrinsic to the Socratic strategy, and similar 
cases that have different values on the dependent variable 
usually require the most extensive elaboration of the 
underlying causal structure to explain. 

Figure 2 shows the causal structure that was derived by 
the student during the dialogue. I have depicted it here to 
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Fig. 2 The causal structure built up by the student 
during the dialogue in Table 4. 
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help explain how the Socratic rules were applied in this 
dialogue fragment.. There are two aspects of the diagram 
that differ from Fig. 1: the explanation/ link and the 
disenabling link, both of which relate causal links to other 
nodes. In a more detailed representation these two kinds of 
links would be attached to causal nodes with antecedent and 
consequent links (see Norman, Ruraelhart, & the LNR research 
group, 1975). The explanation link is a formalism to allow 
for expansion. of any causal link into its intermediate 
steps, which the student was forced to do by one of the 
teacher^'s questions. The notion of disenablement derives 
from Abelson (197^), and was necessary to characterize the 

way the student tre/at.ed certain concepts as negating other 

/ 

causal dependencies. ^ 

The dialogue starts with the teacher picking a well 
known case, the American revolution, and asking for the 
value of the dependent variable "which side to support." The 
student said he would support the American side, because 
they fought for their rights. This established the first 
causal dependency in Fig. 2. In line 5, as in the earlier 
dialogue, the tutor formulated the student's explanation as 
a general rule, altering slightly the dependent variable 
from "support" to "admire". Again the student agreed with 
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Table H 

Atf-hypothetical dialogue by R.C^^^^^^And 

1 T: If you'd been alive during the American ■ Revolution, 
' which side would you have been on? (RUle 1: Ask about 

the value of the dependent variable for a known case) 



2 S; The American side 



3 T: Why? (Rule 2: Ask for any factors) 



4. 



4 S: They were fighting for their rights. 

5 T: YoM admire people who fight for their rights. Is that 

true? (Rule 5: Formulate a general rule for an 
insufficient factor) 

6 S: Yes. 

7 T: How about the young men who broke into the draft 

♦ 

office and burned the records? Do you admire them? 
(Rule 6: Pick a counterexample to the general rule) 

8 S: No, what they did was wrong. 

9 T; I thought you said you admired people who fight for 
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their rights; so why don't you admire the draft 
resistors? (Rule 21: Ask for consideration of a* 
possible value) 

10 S: I do admire them in a certain sense, ITut what they did 

was wrong. 

« 

11 T: What was wrong about it? (Rule 4: Ask ifor prior 

factors) 

12 S: They broke the law. 

13 T: Why is that wrong? (Rule 3: Ask for intermediate 

factors) 

H S: It's Cbvious. If everyone broke the law ^there would 
be chaos. 

15 T: You are saying that what the draft resistors did was 

wrong because they broke the law. The American 
revolutionaries broke the laws, too. Therefore, to be 
consistent, you would have to say that what they did 
was wrong. (Rule 6: Pick a counterexample for ' an 
insufficient factor) 

16 S: That was different. Those were unjust laws. They 

43 

44 



didn't recognize the authority of the government of^ 
'that time. 

17 T: The draft resistors say that the war in Viet' Nam is 

innofal. They say that they have the right, in fact a 
moral oblifation, to defy the laws that support this 
( war. (Rule 6 afeain). 

18 S: I don't think Viet Nam is such a good thing, but you 

lust can't have individuals deciding which laws they 
are going to obey. • . 

19 T: So, you would say the American revolutionaries should 

have followed the law. (Rule 20: Trace the 
consequences .of an inconsistent prediction) 

20 S: Yes, I guess so. 

^21 T: If they had obediently followed all the laws we might 
not^ have had the American Revolution. Is that right? 
(Rule 20 again) ^ 

22 S: Yes. 

23 T: They should have obeyed the laws even if they believed 

they were unjust. Is that right? (Rule 20 again)) 
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2K S: I'm not sure. I suppose I have to say yes. 

25 T: In other words what the American revolutionaries did 

was wrong. That's true isn't it? (Rule 20 again) 

« 

26 S: No, damn it. ' They were in the right. They were 

fighting for their liberty. They didn't have any 
voice in the government. There was taxation without 
representation. 

27 T: So you would say that people do have a right to 

disobey laws if they don't have a voice in the 
government? (Rule 5: Formulate a general rule for an 
insufficient factor) 

28 S: Yes 

29 T: The draft resistors don't have a voice in the 

^ government. According to what you have said, this 
means they do have a right to disobey the draft laws. 
Is that true? (Rule 6 again) ♦ 

30 S: No. We have a democracy. The President and Congress 

are elected by the people. Therefore, the draft 
resistors are represented. They do have a voice. 
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the general principle, but instead of telling the student he 
was- wrong, the tutor 'responded with a counterexample. He 
chose as a counterexample a group of people Ibe student was 



rights. In order to deal with this counterexample the 
student declared that the causal dependency above was 
disenabled when the people's actiorte were wrong. This 
established the first disenablement in Fig. 2. 

The tutor further elaborated the student's causal 
structure by several "why" questions that established the 
notion that breaking the law leads to actions being wrong. 
Then the tutor in line 15 brought up the American 
revolutionaries as a counterexample, because they too broke 
the law, though the student did not regard, their actions as 
wroi^^ To deal with this counterexample, the student 
developed the disenablement that unjust laws are all right 

0 

to break. Then the tutor in line 17 returned again to the 
draft • resistors as a counterexample, because they too broke 
what they considered to be unjust laws. At this point the 
student temporarily gave up the disenablement he had 
proposed. But in tracing the consequences of the causal 
structure built up (lines 19-25), he realized that anothifer 
' disenabling conditio/i ("the people having no voice in the 



government" together with "unjust laws") will differentiate 
the American revolutionaries from draft resistors. Thus the 
dialogue ended with a partial victory by the student, and the 



not likely to admire, but who were f 
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development af a complicated causal .structure. 

Tables 5 and 6 show two short dialogues with the 
Sodratic system (Swets & Feurzeig, 1965): in the first the 
student tries to identify the disease of a patient given 
various symptoms and in the second he. tries to identify a 
random letter of the alphabet given various features. This 
was a CAI system developed to force the student to reason 
^ith causal dependencies he had already learned, such as 
goes on in me^'dical diagnosis. This system is particularly 
rich in strategies for deaTing with predictions by .the 
student, and, in particular, forcing him to consider 
relevant factors, to ignore irrelevant factors, and to 
consider alternative hypotheses. 

Table 5 is from the middle of a dialogue where the 
student had earlier collected a large amount oi* data about 
the particular case. \ The fragment starts out by testing the 
student's ability to make a prediction about the dependent 
variable for this case, where the correct solution is 
unknown. There are two rather nice strategies that occurred 
after this. One strategy (line 9) involved asking the 
student to consider a hypothesis about the dependent 
variable othep) than the one generated by the student 

V 
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Table 5 



Dialogue with the Socratlc System on medical diagnosis. 



1 T: We've got a fair amount of Information — at least 

enough to raise some, perhap3 several, diagnostic 
possibilities. Have you any In mind? (Rule 16: Ask 
for^a prediction about an unknown case) 

2 S: Yes. 

3 T: Name one. 



5 T: Fine. Pleural pain, dyspnea, fever and the physical 

exam signs and symptoms are certainly consistent with 
pulmonary Infarction. Do you think that shaking 
chills and the presence of rusty sputum further 
support this diagnosis? (Rule 22: Test for consistency 
with a given hypothesis) 

6 S: No. ^ 

7 T: Right. Though the white count is consistent, isn't 

it? (Rule 22 a^aln) 



(Swets & Feurzelg, 1965) 



S: 



Pulmonary infarction . 
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8 S: No. 

9 T: Wrong. The white count is consistent. This should 

further support your diagnosis. We've considered one 
possibility. Do you have another diagnosis in mind? 
(Rule 16 again) 



10 S: No. 




11 T: In that case I'd li4<e to talk about viral pneumonia. 

(Rule 21: Ask for consideration of a possible value). 
The tachycardia, high WBC, elevated respiratory rate, 
shaking afttlls, bloody sputumj and severe pleural pain 
all lend weight to that diagnosis right? (Rule 22: 
Test for inconsistency with a given hypothesis) 

12 S: Yes 

13 T: You're way off base. There's not an iota of truth to 

any part of what I just said; in fact, the opposite of 
what I said is true. You'd better review some 
elementary medicine, doctor. 



himself. The other strategy (lines 5, 7, and 11) involved 
asking the student to ijonsider whether various symptbras (or 
factors) were consistent with the value of the dependent 
variable being considered. Both of these strategies tested 
the student's knowledge of how different factors relate, to 
different values of the dependent variable. ; 

In Table 6 three other strategies occurred which teach 
important reasoning skills,, One strategy (lines 9 and 11) 
questions any predictions that are' made without enough 
information/ Anotherr> strategy (line 13) questions the 
student if he asks about -information that is irrelevant to 
predicting the value of the dependent^ variable 
strategy (line 17) . points out when a prediction is 
inconsistent with the factors that have been discussed. 
These three strategies stress the skills of asking the right 
questions and not jumping to a conclusion too quickly. 

CONCLUSIONS 

The theory has taken the particular shape it currently 
has because o^the particular dialogues that were available 
to me for analysis. There is a need to look at a wider 
range of dialogues, such as the Meno itself^ in order to 
obtain a more complete set of rules. Furthermore, because I 
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Table 6 

A dialogue with the Socratic System to identify' a letter 

(Swets & Feurzeig, 1965) 

.1 T: Start when ready. ' . 

2 S: CllRVES? 

3 T: , One . . 



4 S: LOOSE ENDS? 



.-,5. T: Two. 



6 S: OBLIQUES? 



7 T: Zero . 



8 S: C. 



9 T: You don't have enough information yet to get the 



right answer. How do you know i 
example? (Rule 18: Question a pr 
enough information) 



t isn 't J, for 
ediotion made without 



10 S: J. 



ERIC 
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11 T: You don't have enough information. yet . How do you know . 

it isn't C, for example? (Rule 18 again) 

12 S: HORIZONTALS? 

13 T: Zero, That was a wasted question • It did not eliminate 

.any possibilities. (Rule 19: Point out irrelevant 
factors) 

14 S: VERTICALS? ' 

15 T: Zero. Good question. ■ ^ 

16 S:' G. \ 

IT T: Wrong. Your guess is inconsistent with the information 
you've been given. You must have forgotten that the 
right letter hasn't any horizontal lines. The letter 
you guessed can't be right - it has too many loose 
ends. (Rul© 20: Point out an inconsistent prediction) 
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have not seen enough instances of each rule, the 
characterizations of the rules that exist are not likely to 

be in the most general form possible, 

■ / ■ 

As the rules developed a general structure began to 
emerge.- The first set of rules (Rule 1-15) teach the 
student to formulate general principles from specif ic , known 
cases, while the second set (Rules 16-23) teach the student 
to apply gsrfel^ly principles that he has learned 
(abstracted) to unknown cases. Further, within the first 
set there is a structure among the three kinds of "Why" 
questions that ask for factors (Rules 2, 3? and 4). TheVe 
is also a parallel structure between the .three kinds of 
rules for handling unnecessary vs. insufficient factors 
(i.e., Rules 5, 6, and 12 parallel Rules 7.> 8, and 13). 
Where such structure emerges,'^ it is possible to specify 
rules (as was done for Rules 7 and 13) even though they have 

not occurred in the data. 

/ 

In order to make the theory in any sense a complete 
theory, it is 'dearly unnecessary to pursue the search for 
greater structure through further data analysis. In 
particular, the lack of any structure among* the rules for 
applying known principles to unknown cases emphasizes their 
tentative nature. One important possibility is that there 
may be one-to-one correspondence between the formulation 
rules (Rules 1-15) and the application rules (Rules 16-23) • 
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In fact, Rulei^ 1 In this sense corresponds to Rule 16; one 
asks about the dependent variable for a known case and the 
other for an unknown case. Trying to construct such a 
correspondence will turn up obvious omissions in the 
data-based theory presented here. For example,^ because 
there is a rule (Rule 19) for handling irrelevant factors 
among the application rules, it suggests there must be some 
such rule in the formulation rules, though there is none 
currently. Though the theory's origin Is mired In inelegant 
data, it -may yet find elegance through structure. 
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teaching strategies used by the tutors in the dialogues withir 
a content- independent formalsim. 

The paper includes twenty-three production rules derived from 
the data analyzed, together with segments of the data showing 
the actual application of the rules in different tutorial 
dialogues. The strategies themselves teach students; (1) 
information about different cases, (2) the causal dependenciej 
that underlie these cases, and (3) a variety of reasoning 
skills.^ These include such abilities as forming hypotheses, 
testing/' hypotheses, distinguishing between necessary and 
sufficient conditions, making uncertain predictions, determin- 
ing the reliability or limitation of these predictions, and 
asking thejrig^t questions when there is not enough 
information to make a prediction. 
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